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ABSTBACT 

The paper surveys the major projects on the 
understanding of natural language that fall vithin vhat may nov be 
called the artificial intelligence paradigm of natural language 
syrtems. Some space is devoted to arguing that the paradigm *is nov a 
reality and different in significant respects from the generative 
paradigm of present-day linguistics. The comparisons between systems 
center round questions about the level, centrality and 
**phenomenological plausibility** of the knowledge and inferences that 
must be available to a system that is to understand everyday 
language. (Author) 
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NATURAL LANGUACE UNDERSTANDING SYSTEMS WITHIN THE A.I. PARADIGM: 
A SURVEY AND SOME COMPARISONS 



Yorick Wilks* 



ABSTRACT: The paper surveys the major projects on the 
understanding of natural language that fall within what 
may now oe called the artificial intelligence paradigm ^ 
of natural language systems. Some space is devoted to , 
arguing that the paradigm is nov a reality and different 
in significant respects from th«2 generative paraSigm of 
present day linguistics. The comparisons between systems 
center round questions about the level, centrality and 
"phenomenological plausibility" of the knowledge and in- 
ferences that must be available to a system that is to 
understand everyday language. 
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1. INTfTODUCTION 

In his report to the Science f^esearch Council on the 

state of Artificial -Intelligence, Sir James Lighthill (1973 ) 

geve most of the field a rather bad prognosis. One of the few 

hopeful signs he saw was Winograd's (1972 ) natural language 

understanding system* Yet now, only a year later, Winocrad 

has stopped work on the system he constructed, and has be- 

$$ 

gun a new one on entirely different principles* He went so 
far, in a survey lecture (Winograd '73 ) of extraordinary 
modesty in a field not known for its small claims, to place 
his celebrated early work in only the 'first generation' 
of computer systems designed to understand natural language^ 
and went on to describe others' 'second generation' systems*. 

I shall return later to this metaphor of generations, 
but what is one to say in general terms of a field where 
yesterday's brightest spots are today's first generation 
systems, even though they have not been criticised in print, % 
nor shown in any generally acceptable way to be fundamentally 
wrong? Part of the answer lies in the profound role of 
fashion in Artificial Intelligence in its present pre-scientif ic 
phase* A cynical American professor remarked recently that 
Artificial Intelligence (AI) had an affair. with someone's work 
every year or two, and that, just as there were no reasons 
for falling in love, so, later, there were no reasons for 
falling out again* In the case of Winograd's work it is im-- 
portant now to resist this fashion, and re-emphasise what a 
good piece of research it was, as I shall in a moment* 

Another part of the answer lies in the still fundamental 
role of metaphysical criticism in AI*' In the field of com- 
puter vision things are bad enough, in that anybody who can 
see feels entitled to criticise a system, on the ground that 
he is sure he does not see using such and such principles* 



$$ 

see (Winograd *74b) 
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In the field of natural language under staiul i ng things are 
worse: not only does anyone who can speak and write feel 
free to criticise on. the corresponding grounds^ but in ad- 
dition there are those trained in disciplines parasitic upon 
natural language, linguists and logicians, w!\o often know 
in addition how things MUST BE DONE on a priori grounds. 
It is this metaphysical aspect of the subject that gives 
its disputes their characteristically acrimonious flavour. 

In this paper I want to sort out a little what is agreed 
and what is not; what are some of the outstanding disputes 
and ho\. testable are the claims being made. If what follows 
seems vnduly philosophical, it should be remeoibered that 
little is agreed, and almost no achievement s . are beyond 
question. To pretend otherwise, by concentrating only on 
the details of established programs, whould be meretricious 
c.nd mislea^ding. 

To survey an energetic field like this one is inevibably^ 
to leave a great deal of excellent work unexamined, at least 
if one is going to do more than give a paragraph to each re- 
search project. I have left out of consideration at least 
six groups of projects: 

(1) Early work in Artificial Intelligence and 

Natural Language that has been surveyed by 
( 1973) 

Winograd/and Simmons (1970a ) among others . 

(2) Work by graduate students of, or intellectually 
dependent upon that of , people discussed in 
some detail here. 

'* described 

(3) Work that derives essentially from projedts/in 

detail here. This embraces several groups in- 
terested in testing psychological hypotheses, 
as well as others constructing large-scale 
systems for speech recognition. I have devoted 
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no spaco to speech recognition as such here, 
for it seems to mf» to depend upon the quality' of 
semantic and inferential understanding as much 
as anything, and so I have concentrated upon 
this more fundamental task. 

(4) Work on language generators, as opposed to 
analysers and understanders. They are essential 
for obtaining any tes table output , but are 
theoretically secon dary . 

(5) All the many and varied reasoning schemes 

now available in AI, including PLANNER (Hewitt 
1969 ) , QA4 (Rulifson et al 1972 ) , MERLIN 
(Moore and Newell 1973 ) , as well as automa- 
tic programming (Balzer et al 1974 ) (Heidorn 
- 1.974 ) • and debugging (Sussman 1974 ) pro- 
jects, many of which are producing formalisms 
that appear increasingly like natural language. ^ 

(6) Conservative reasoning schemes, such as first' 
order predicate calculus, that have been applied 
to, or advocated for, the analysis of natural 
language: (McCarthy and Hayes 1969 ) (Coles 
1972 ) (Sandewall 1972 ) . 

The exclusions under (2) above are particularly unfair 
to the work in the unpublished theses of Rieger (1974 ) 
and McDermott (1974 ), and can only be justified, like 
those of sections (5) and (6) a^ove, by space, bias and 
the conspirations advanced in a later section of this survey 
concerning what it is for Al research to be about nat ura 1 
language , rather than about something clse^like human psychology, 
or logic^ or the bargaining behavior of children under stress. 

One final remark about the style of this survey. I 
have not indulged the normal critical luxury of careful and 
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extensive quotation from authors followed by detailed and 
meticulous criticism. That would be wholly inappropriate 
in the present state of things. A great deal of work is 
being done at the moment, and many of the principal researchers 
change their views on very fundamental questions between one 
paper and the next without drawing any attention to the fact. 
Cheap self-contradictions and changes of mind are all too 
easy to find, so criticism and comparisons are best drawn 
with a very broad brush and a light stroke. 



2 . WINOGRAD'S UNDERSTANDING SYSTEM 

Winograd's system runs as a dialogue, in real time, 
between a human operator who types in messages, and the 
system proper, called SHRDLU, which displays on a screen 
pictures of a closed world of coloured blocks and pyramids, 
a box into which they can be put, and an arm or crane that \ 
can move the objects about. SHRDLU displays its replies 
to the operator by writing on the same screen. The follow- 
ing is a discortinuous sample of the dialogue Winograd gives 
in his book. SHRDLU* s replies are in upper case: 
pick up the big red b]cck 
OK 

find a block which is taller than the one you are holding 
and put it into the box. 

BY 'IT*, I ASSUME YOU MEAN THE BLOCK WHICH IS TALLER THAN 
THE ONE I AM HOLDING 

OK 

what does the box contain 

THE BLUE PYRAMID AND THE BLUE BLOCK 

had you touched any pyramid before you put the green one on 
the little cube 

YES, THE GREEN ONE 



when did you pick it up 

WHILE I WAS STACKING UP THE RED CUBE, A ' LARGE RED BLOCK AND A LARGE GREEN CUBE, 
why 

TO GET RID OF IT. 

This ingenious program was also able to accept new definitions of words, 
such as 'steeple* J to make use of what it knew about the properties of the 
objects described, such as that a block could have its top cleared off, but a 
pyramid could not^ and also to remember what it had done before, as in the 
san^le above. 

$$ 

The program was written in the language PLANNER , which is a concrete 
expression of the slogan "meanings are procedures", a sentiment into whose own 
meaning it is probably best not to enquire too closely for the moment, but 
which has undoubtedly led to a new style of programming* PLANNER is a theorem 
proving language: it tries to establish the truth of assertions, not in the 
normal uniform, proof- theoretic, manner, but by accepting a range of "programmed 
hints" about how best to proceed at any point. In a language un&erstanding 
program like Winograd's, this means replacing familiar grammar rules such as 
S — NP + VP (a sentence consists of a noun phrase followed by a verb phrase) 
by procedures, in this case: 

((PDEFINE SENTENCE ((PARSE NP) NIL FAIL) ((PARSE VP) FAIL FAIL RETURN))) 

The details of the notation need not detain us at this point? what is 
in^xDrtant is that Winograd's grammar is not the conventional list of rules, 
but small sub-programs like the lines above, that actually represent procedures 
for imposing the desired grammatical structure. 

The first level of linguistic procedures in the system expresses a 'systemic 
grammar', due to M*A.K. Halliday (1970), which imposes a hierarchical structure 
of clauses on the input sentences, which in turn seem to be drawn from a voca- 
bulary of about 175 vsords. 

After this syntactic parsing, a number of "semantic specialists" attach 
semantic structures to specific syntactic ones. A semantic definition of an 



Actually the grammar was written in a language PROGRA^4^AR, and the semantic 
and inference parts of the program in LISP and a subset of PLANNER called 
MICROPLANNER. 
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action like "grasp" would be of the form 

(CMEANS( (( (# ANIMATE) ) ( (#MANIP) ) ) 
( /^EVAL (COND ( (PROGRESSIVE) 

(QUOTE (# GRASPING #2 *TIME) ) ) 
(T (QUOTE (# GRASP #2 *TIME 
)) )))NIL)) 

which says essentially that grasping is something done by an animate entity 
to a manipulable one (first line). More of the real content of such actions 
is found in their inferential definition. Here is the one for "pickup": 

(DEFTHEOREM TC-PICKUP (THCCXJSE (X(WHY (EV))EV) 

(itPICKUP $?X) (MEMORY) (THGOAL(i^GRASP $?X) (THUSE TC-GRASP)) 
(THGOAL (i^RAISEHAND) (THNODB) (THUSE TC-RAISEHAND) ) 
(MEMOREND (i^PICKUP $?EV $?X)))) 

Once again the details of the notation need not be explained in order to 
see that the word is being defined in terms of a number of raore primitive sub- 
actions, such as RAISEHAND/ each of which must be carried out in order that 
something may indeed be picked up. 

In the case of "a red cube"/ the following structure is built up by an 
NP (noun phrase) "semantic specialist": 

(GOAL (IS X BLOCK) ) 
(GOAL (COLOR X RED)) 

(EQDIM X) PLANNER description 

(BLOCK MAN IP PHYSOB THING) markers 

The first three lines are procedures that, when evaluated, will seek an 
object X that is a block, is equidimensional (EQDIM ) and is red. The last 
line is a set of "semantic features" read off right to left from the following 
"feature tree": 



mm 



PLACE I SHAPE 

PROPERTY iSIZE 



I LOCATION 
I COLOR 
ANIMATE 



I ROBOT 



I HUMAN 



I BLUE 
I RED 



THING 



I BLACK 
I WHITE 
I GREEN 



ISTACK 

IPILE 

IROW 



PHYSOB— 



I CONSTRUCT- 
I HAND 



~ ITABLE 



IMANIP- 
I BOX 



[PYRAMID 
I BLOCK 
I BALL 



I EVENT 



RELATION 



ITIMELESS 



This whole semantic structure can be used by the deductive component of 
the system, before any evaluation resulting in the actual picking up of the 
object, so as to see if such an object is possible. If it is not, (as "equi- 
dimensional pyramid" would not be) , the system could go back and try to re- 
parse the sentence. » 

One reason for the enormous inpact of this work was that, prior to its 
appearance, AI work was linguistically trivial, while the systems of the 
linguists had no place for the use of inference and real world knowledge. 
Thus a very limited union between the two techniques was able to breed con- 
siderable results. Before Winograd there were few programs in AI that could 
take a reasonable complex English sentence and ascribe any structure whatever 
to it. In early classics of 'natural language understanding', in AI, such as 
Bobrow's STUDENT (1968) problem solver for simple algebra, input sentences had 
to be short and of stereotyped form, such as "what is the sum of.... ?" 
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Conversely, in linguistics, thero was, until very 
recently, little speculation on how we understand the 
reference of pronouns in such elementary sentencesj|^"|he 
soldiers fired at the women and T saw severa I fall", 
where it is clear that the answer is both definite, and 
that finding it requires some inferential manipulation of 
generalizations about the world. The reader should ask 
himself at this point how he knows the^eferent of the 
pronoun in that sentence. 

3 . SOME DISCUSSION OF SHRDLU 

So far, the reaction to Winograd's work has been wholly 
uncritical. What would critics find to attack if they were 
so minded? Firstly, that Winograd's linguistic system is 
highly conservative, and that the distinbtion between 'syn- 
tax* and 'semantics' may not be necessary at all. Secondly, 
that his semantics is tied to the simple referential world 
of the blocks in a way that would make it inextensible to 
any general, real world, situation. Suppose 'block' were 
allowed to mean 'an obstruction' and 'a mental inhibition', 
as well as ' a cubic object'. It is doubtful whether Winograd' 
features and rules could express the ambiguity, and, more 
importantly, whether the simple structures he manipulated 
could decide correctly between the alternative meanings 
in any given context of use. Again, far more sophisticated 
and systematic case structures than those he jised might be 
needed to resolve the ambiguity of 'in' in 'He ran the mile 
in five minutes', and 'He ran the mile in a paper bag', as 
well as the combination of case with word sense ambiguity 

in 'He put the key in the lock' (door lock) and 'He threw 
the key in the lock" (river lock) . 
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The blocks world is also strongly deductive and logically closed. If 
gravity woro introduced into it, then anything supported that was pushed in a 
certain way would have, logically have, to fall. But the common sense world, 
of ordinary language, is not like that: in the 'women and soldiers' example 
given earlier, the pronoun 'several' can be said to be resolved using some 
generalisation such as 'things shot at and hurt tend to fall'. There are no 
logical 'have to's' there, oven though the meaning of the pronoun is perfectly 
definite. 

Indeed, it might be argued that, in a sense, and ag regards its semantics » 
Winograd's system is not about natural language at all, but about the other 
technical question of how goals and stab-goals are to be organised in a problem- 
solving system capable of manipulating simple physical objects. If we remember # 
for exan^le, that the key problem that brought down the enormous work on machine 
translation in the Fifties and Sixties, was that of the sense ambiguity of 
natural language words, then we will look in vain to SHRDLU for any help with 
that problem. There seems to be only one clear e^rample of an ambiguous word 
in the whole system, namely that of "contain" as it appears in 'The box contains 
a red block' and 'The stack contains a red block'. 

Again, if one glances back at the definition of 'pickup' quoted above,^ 
one can see that it is in fact an expression of a procedure for picking up an 
object in the SHRDLU system. Nothing about it, for exaxaple, would help one 
understand the perfectly ordinary sentence 'I picked up my bags from the plat- 
form and ran for the train', let alone any sentence not about a physical action 
performcible by the hearer. One could put the point so: what we are given in 
the PLANNER code is not a sense of 'pick up' but an exanple of its use, just as 
'John picked up the volunteer from the audience by leaning over the edge of 
the stage and drawing her up by means of a rope clenched in his teeth' is not 
so much a sense of the verb as a use of it. 

Those who like very general analogies may have noticed 
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that Wittgenstein (1953 para* 2ff* ) devoted considerable 
space to the construction of an elementary language of blocks, 
beams and slabs? one -postulated on the assumption that the 
words of language were basically, as is supposed in model 
theory, the names of items* But, as he showed of the en- 
terprise, and to the satisfaction of many readers, "That 
philosophical concept of meaning (i*e* of words as the un- 

ambigous names of physical objects YW) has its place in 

a primitive idea of the way language functions* But one 

can also say that it is the idea of a language more primitive 

than ours " . (my italics)* 

To all this, it might be countered that it has not been 
shown that the language facilities I have described cannot 
be incorporated in the structures t/iat SHRDLU manipulates, 
and that, even if they could not, the work would still be 
significant in virtue of its original control structure and 
its demonstration that real world knowledge can be merged 
with linguistic knowledge in a w»^rking whole* Indeed, al- 
though Winograd has not tried, in any straightforward sense, 
to extend the SHRDLU system one could say that an extension 
of this sort is being attempted by Brown (1974 ) with his 
•Believer System*, which is a hybrid system combining a com- 
ponent about beliefs that is, in the sense of section 4 below 
•second generation*, with a base analyser from Bruce*s 

CHRONOS system (1972 ) which is a micro-world late first ' 

generation system in the same sense as Winograd*s, Others 

in the ^A:Vtegory that should be mentioned are Davies and 
Isard*s (1972 ) exploration of the concepts of •roust* and 
•could* in a micro-world of tic-tac-to6, and Joshi's ex- 
tension of it (1973 ), but above all the important and in- 
fluential work of Woods (1972 )* 



This work, most recently applied to a micro-world of 
lunar rock samples, is not discussed in the detail it de- 
serves in this paper. The system^based on an augmented state 
transition network grammar, is undoubtedly one of the most 
robust in actual use, in that it is less sensitive to the 
PARTICULAR input questions it encounters than its rivals. 
The reason for not treating it in depth is that both Woods 
and Winograd have argued in print that their two systems are 
essentially equivalent (Winograd 1971 ) (Woods 1973 ), and 
so^if they are right, there is no need to discuss both, and 
Winograd's is, within the AI community at least, the better 
known of the two. 

Their equivalence arguments are probably correct: both 
are grammar-based deductive systems, operating within a ques- 
tion-answering environment in a highly limited domain of 
discourse. Winograd's system of hints on how to proceed, 
within his PROGRAMMAR grammar, is, as he himself points out, 
formally equivalent to an augmented state transition net- 
work, and in particular to the ordering of choices at nodes 
in Woods' system. 

There is a significant difference in their metaphysical 
approaches, or presuppositions about meaning which, howevej^ 
has no influence on the actual operation of their respective 
systems. This difference is disguised by the allegiance 
both give to a 'procedural view of meaning'. The difference 
is that Woods takes a much more logico-semant ic interpretation 
of that slogan than does Winograd. In particular, for Woods 
the meaning of an input utterance to his system is the pro- 
cedures within the system that manipulate the truth conditions 
of the utterance and establish its truth value. 

To put the matter 



crudely, for Woods an assertion has no meaning if his system cannot establish 
its truth or falsity. Winograd has cer^tainly not committed himself to any 
such extreme position. 

It is interesting to notice that Woods* is, in virtue of his strong 
position on truth conditions, probably the only piece of work in the field of 
AI and natural language to satisfy Hayes* (1974) recent demand* that to be 
"intellectually respectable" a knowledge system must have natural model theore- 
tic semantics, in Tarski's sense. Since no-one has ever given precise truth 
conditions for any interesting piece of discoxirse, such as, say. Woods* own 
papers, one might claim that his theoretical presuppositions necessarily limit 
his work to the analysis of micro-worlds (as distinct from everyday language)* 
However, if Woods* ** internal" interpretation of the "meanings are procedures" 
slogan has certain drawbacks, so too does Winograd* s, or what one might call 
the "external** interpretation. By that I mean Winograd' s concentration on 
actions, like picking up, that are in fact real world procedures, and in a way 
that the meanings of "concentrate", "call" , "have** , *• interpret" , etc. are not 
self-evidently real world procedures that we could set out in PLANNER for a 
robot. Of course, Winograd is free to concentrate on any micro-world he , 
wishes, and all I am drawing attention to here is the danger of assuming that 
natural language is normally about real world procedures and, worse still, 
the in5>licit making of the assunption that we cannot understand discourse €±>out 
a procedure unless we can do it otirselves . I am not saying that Winograd is 
making this evidently false assumption, only that the rhetoric surrounding the 
application of the "meanings are procedures" slogan to his system may cause the 
unwary to do so. 

There is quite a different and low-level problem about the equivalence of 
Wbods* and Winograd *s systems, if we consider what we might call the received 
coraraon-sense view of their work. Consider the following three assertions: 

(1) Wbods* system is an implementation of a transformational grammar* 

(2) Winograd *s work has shown the irrelevance of transformational grammar 
for language analysis - a view widely held by reviewers of his work. 

(3) Wbods* and Winograd* s systems are formally equivalent - a view held 

*a view modified in Hayes (1975) where it now seems that programs/procedures 
would serve as a *'semantics" instead, a quite different, and more reasonable, 
position, of course. 



by both of them. 

There is clearly something of an inconsistent triad amongst those three 
widely held beliefs. The trouble probably centers on the exact sense which 
Woods* work is formally equivalent to a transformational grammar - not a 
question that need detain us here, but one worth pointing out in passing. 
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4. SOME MORE GENERAL BACKGROUND ISSUES 

Winograd's work is a central example of the 'Artificial 
Intelligence paradigm of language', using 'paradigm' in 
Kuhn's (1970) sense of a large scale revision in systematic 
thinking, where the paradigm revised is the 'generative para- 
digm' of the Chomskyan linguists (Chomsky 1957 ). From 
the AI point of view, the generative linguistic work of the 
last fifteen years has three principal defects. Firstly, 
the generation of sentences, with whatever attached structures^ 
is not in any interesting sense a dempnstra t ion of human 
understanding, nor is the separation of the well-formed, 
from the ill-formed, by such methods? for understanding 
requires, at the very least, both the generation of sentences 
as parts of coherent discourse, and some attempt to interpret^ 
rather than merely reject, what seem to be ill-formed utter- * 
ances. Neither the transformational grammarians following 
Chomsky, nor their successors the generative semanticists ^ 
(Lakoff 1971 ), have ever explicitly renounced the genera- 
tive paradigm. 

Secondly, Chomsky •s distinction between performance 
and competence models, and his advocacy of the latter, have 
isolated modern generative linguistics from any effective 
t o^f the systems of rules it proposes. Whether or not 
the distinction was intended to have this effect, it has 
meant that any test situation necessarily involves performance, 
which is considered outside the province of serious linguis- 
tic study. And any embodiment of a system of *rules in a com- 
puter, and assessment of its output, would be performance. 
AI, too, is much concerned with the structure of linguistic 
processes, ijridepe nf ent of any particular implementat ion f ^but 
implementation is never excluded, as it is from competence 
models, but rather encouraged. 



$$ 

Vide: "Artificial Intelligence is the study of intellectual 

m how such 
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mecHsriigfig di6 rfe^ligfeld in tHe human or in aniiiiais ." (McCarthy i^'^^^ 
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Thirdly, as I mentioned before , there was until recently 
no place in the generative paradigm for inferences from 
facts and inductive generalisations, even though very simple 
examples demonstrate the need for it. 

This last point ^about the shortcomings of con- 
ventional linguistics is not at all new, and in AI is at 
least as old as Minsky's (1968, p. 22 ) observation that 
in 'He put the box on the table. Because it wasn't level, 
it slid off, the last 'it' can only be referred correctly 
to the box, rather than the table, on the basis of some 
knowledge quite other than that in a conventional, and im- 
plausible, linguistic solution such as the creation of a 
class of 'level nouns' so that a box would not be considered 
as being or not being level. 

These points would be generally conceded by those who 
believe there is an AI paradigm of language understanding, 
but there would be far less agreement over the positive 
content of the paradigm. The trouble begins with the defini- 
tion of 'understanding' as applied to a computer. At one 
extreme are those who say the word can only refer to the 
performance of a machine; to its ability to, say, sustain 
some form of dialogue long enough and sensibly enough for 
a human interrogator to be unsure whether wha't he is con- 
versing with is a machine or njt . On the other hand, there 
are many, almost certainly a majority, who argue that more 
is required^ in that the methods and representations of 
knowledge by which the performance is achieved must be of 
the right formal sort, and that mere performance based on 
ad hoc methods does not demonstrate understanding. 

This issue is closely related to that of the role of 
deduction in natural language understanding, simply because 
deduction is often the structure meant when • right methods ' 
are mentioned. The dispute between those who argue for. 



Of- .like Winogra^l'v use deductive methods those who 

•advocate other inferential systems closer to common sense 
reasoning, is in many ways a pseudo-issue because it is so 
difficult to define clearly what a non-deductive system is, 
(if by that is meant a system that cannot in principle be 
modelled by a deductive system) since almost any set of 
formal procedures^ including 'invalid inferences', can be 
so displayed. The heart of the matter concerns the most 
most appropriate form of an inference system^ rather than 
how those inferences, may be axiomatised, and it may well 
turn out that the mos . appropriate form for plausible reason- 
ing in order to understand is indeed non-deductive. This 
same insight has laigely defused another heated issue: 
whether the appropriate representations should be procedures 
or declarations. Winograd's work was of the former type, 
as was shown by his definitions of words like- 'pickup' as 

procedures for actually picking things up in the blocks 
simpie 

world. However , /procedural representations usually have 
the disadvantage that, if you are going to indicate, for 
every 'item' of knowledge^ how it is to be used, then, if 
you may use it on a number of kinds of occasion, you will 
have to store it that number of times. So, if you want to 
change it later, you will also have to remember to change 
it in all the different places you have put it. There is 
the additional disadvantage of lack of perspicuity: any- 
one reading the procedural version of the Winograd grammar 
rule I gave earlier, will almost certainly find^the con- 
ventional, declarative, version easier to understand. 

So- then, the fashion for all things procedural has to 
some extent abated (see Winograd 1974 ) . There is general 
agreement that any system should show, as it were, how it 
is actually to be applied to language, but that is not the 
same as demanding that it should be written in a procedural 
language, like PLANNER. I shall return to this last point later 



5. SECOND GENERATION SYSTEMS 

To understand what was meant when Winograd contrasted 
his own With what he called second generation systems, we 
have to remember, as always in this subject, that the gen- 
erations are of fashion, not chronology or inheritance of 
ideas. He described the work of Simmons, Schank and myself 
among others in his survey of new approaches, even though 
the foundations and terminology of those approaches were 
set out in print in 1966, 19^ and 1967. respectively. What 
those approaches, and others, have in common is the belief 
that understanding systems must be able to manipulate very 
complex linguistic objects, or semantic structures, and 
that no simplistic approaches to understanding language 

with computers will work. 

In an unpublished, but already very influential recent 

paper, Minsky (1974) has drawn together strands in the work 

of Charniak (1972) and the authors above using a terminology 

of • f rames ' : 

*A frame is a data-structure for representing a stereo- 
type situation, like a certain kind of living room, or going 
to a children's ^birthday party. Attached to each frame are 
several kinds of information. Some of this is information 
about how to use the frame. Some is about what one can ex- 
pect to happen next. Some is about what to do if these ex- 
pectations are not confirmed. 

We can think of a frame as a network of nodes and rela- 
tions. The top levels of a frame are fixed and represent 
things that are always true about the supposed g^ituation. 
The lower levels have many terminals— • slots • that must 
be filled by specific instances or data. " Each terminal can 
specify conditions its assignments must meet.... simple 
conditions are specified by markers that might require a 
terminal assignment to be a person, an object of sufficient 
value, etc. ... " 

The key point about such structure^ is that they attempt 
to specify ifl atdvjihce what is going to be said, and how the 
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world encountered is going to be structured. The structures/ 
and the inference rules that apply to them, are also ex- 
pressions of 'partial information' (in McCarthy's phrase) 
that are not present ift first generation systems. As I showed 
earlier, with the 'women and soldiers' example, such loose 
inductive information, seeking confirmation from the surround- 
ing context, is required for very simple sentences. m 
psychological and visual terms, frame approaches envisage 
an understander as at least as much a looker as a seer. 

I shall now describe briefly five approaches that might 
be called second generation. 

Char niak 

The new work which owes most to Minsky's advocacy is 
Charniak's. He studied what sorts of inferential informa- 
tion (Charniak '72, '73, '74) would be needed to resolve 
pronoun ambiguities in children's stories, and in that sense • 
to understand them. One of his example 'stories' is: 
•J^ was invited to J*,t*^; ' s birthday party. She wondered 
if he would like a kite. A friend told Jane that Jack al- 
ready had a kite, and that he would make her take it back'. 

The problem concerns the penultimate word 'it', and 
deciding whether it refers to the first kite mentioned or the 
second. Charniak's analysis begins by pointing out that 
a great deal of what is required to understand that story is 
implicit: knowledge about the giving of presents, knowledge 
that if one possesses one of a certain sort of thing then 
one may well not want another^ and so on. 

Charniak's system does not actually run as a program, 
but is a theoretical structure of rules called 'demons' 
that correspond roughly to what Minsky later called frames. 
A demon for this example would be, 'if we see tha-t a person 
might not like a present X, then look for x being returned 
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to the store^ where it was bought. If we see that happening, or 
even being suggested, assert that the reason why is that P 
does not like X • . 

The important words there are 'look for', which suggest 
that there may well be confirming hints to be found in the story 
and, if there are, then this tentative, partial^ inference is 
correct, and we have a definite and correct answer. This ap- 
proach, of using partial (not necessarily true) inferences, 
in order to assert a definite answer, is highly characteris- 
tic of 'second generation' systems. 

The demons are, as with Winograd's work, expressed in 
a procedural language which, on running, will seek for a 
succession of inter-related 'goals'. 

Here^ for example , is a demon concerned with another 

story^ about a child's piggy bank (PB) and a child shaking 

it^ looking for money |?ut hearing no sound. The demon^ 

PB-OUT-OF, is formalised as: 

( DEMON PB-OUT-OF 

(NOLD PB PERSON M N) 

(?N OUT-OF ?M ?PB) 

(GOAL (? IS ?PB PIGGY-BANK)) 

(GOAL (? IS ?M MONEY) $DEDUCE) 

(GOAL (?NOJ,D SHAKE 7PERS0N ?PB)$TRUE) 

(ASSERT (? HAVE 7PERS0N ?M)) 

(ASSERT (? RESULT ?N ?NOLD))). 

Again, it is not necessary to explain the notation in 
detail to see that conditions are being stated for the con- 
tents of a piggy bank having been emptied. The pattern being 
sought by the demon in operation is the third line. If a 
chain of demons can 'reach' one of the possible referents in a 
Story then there is a success registered and the ambiguity 
of the corresponding pronoun is resolved.' 

It can be seen that the information encoded in the 
system is of a highly specific sort— -in the present case it 
is not about containers as such, and how to get their contents 



out, but al)out Piggy Banks in particular, and everything relies on 
that particular knowledge having been put in* Not all 
the knowledge is of this general sort: in a recent paper 
(Charniak '74) where the 'kite' story is reconsidered there 
are rules of considerable generality and interest* One such 
is what Charniak calls a R+SSA rule: 

"If the story gives information which would make it 
plausible to infer that PERSON is favorably inclined towards 
action A, and PERSON does S, a significant subaction (SSA) 
of A, then infer that PERSON is doing A" » 

An important assumption of Charniak's is what i shall 
call his 'decoupling assumption', namely that this work 
on the knowledge-based determination of reference can be 
effectively decoupled from any particular syntactic or semantic 
representation, or of .its application, and can be explored 
in isolation* Thus, the apparently English words in the 
PB-OUT-OF demon above do not have any particular status other 
than that of English words that happen to occur in the stories 
being examined* I shall return to this assumption later* 

Colby 

Colby has (Colby et al '71), (Enea and Colby '73), 
^Colby and Parkison, ' 74 ) developed over a period of 

several years an on-line dialogue system that simulates a 
paranoid patient called PARRY* A measure of its success is 
that it is perhaps the most used A*I* program in existence; 
used, 'that is, by those outside the research project that 
developed it* HeiE is a discontinuous sample of its output, 
again with the system's responses in the upper case: 

Have you been hospitalised before? 
THIS IS THE FIRST TIME* 
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How long hAVQ you been there? 

ABOUT TWO WEEKS, 

Any headaches? 

MY HEALTH IS FINE. 

Are you having any difficulty with your memory? 
NO. 

Then perhaps you can tel 1 me who is the Pres ident of the 
United States? 

NIXON IS PRESIDENT. 

What day is it today? 

TODAY IS THURSDAY. 

V^hat season is it? 

LETS GET ON WITH THE INTERVIEW. 

Colby's aim was to produce a system that was not^ 
; 'fragile* intheway that most A.I. SySfeSms are : 

one that did not break down, or give up, if fcfife IBgUt was 
not exactly what it expected; but one that carried on some- 
how in all cirfcHmstances , in the way that conversing humans 
do • 

i^fMyilitJ^ is avoiafed by having no conventional syntax 
aHdlySSr, and by not tetfen afefeSHipting to take account of all 
the words in the input. This is a consid*^*^able aid, since 
any parser that begins to parse a more than 'usually polite 
request such as 'Would you be so kind as to....' is going 
to be in trouble, British English speakers arriving in 
the U.S. quickly learn to delete such phrases^ since they 
cause great confusion to human listeners in stores. 

The input text is segmented by a heuristia that breaks 
it at ^n^2^^^ arrange of key words. Patterns are then matched 
with each segment. There are at present about 1700 patterns 
on .a list (Colby and Parkison, in press) that is stored 
and ma*-ched^ not against any syntactic or semantic representa- 
tions o^ words -^^ . 



but against the input word string direct, and by a process of sequential 
deletion. So, for oxanplo, "What is your main problem** has a root verb 
"BE" substituted to become 

WHAT BE YOU MAIN PROBLEM. 
It is then matched successively in the folloWing*«rms after successive 
deletions: 

BY YOU MAIN PROBLEM 
WHAT YOU MAIN PROBLEM 
WHAT BE MAIN PROBLEM 
WHAT BE YOU PROBLEM 
WHAT BE YOU MAIN 

and only the penultimate line exists as one of the stored patterns^ and so is 
matched. Stored in the same format as the patterns are rules expressing the 
consequences for the "patient" of detecting aggression and over- friendliness 
in the interviewer's questions and remarks. The matched patterns found are 
then tied directly, or via these inference rules, to response patterns which 
are generated. 

Enormous ingenuity has gone into the heuristics of this system, as its 
popularity testifies. The system has also changed considerably: it is now 
called PARRY2 and contains the above pattern matching, rather than earlier key 
work, heuristics. It has the partial, or what some would call "pragmatic", 
rules about expectation and intention, and these alone might qualify it as 
"second generation" on some interpretations of the phrase. A generator is also 
being installed to avoid the production of only "canned" responses. 

Colby and his associates have put considerable energy into actually trying 
to find out whether or not psychiatrists can distinguish PARRY'S responses from 
those of a patient (Colby and Hilf '13). This is probably the first attempt 
actually to apply Turing's test of machine-person distinguishability. There 
are statistical difficulties about interpreting the results buc, by and large, 
the result is that the sample questioned cannot distinguish the two. Whether 
or not this will influence those who still, on principle, believe that PARRY is 
not a simulation because it "does not understand", remains to be seen. It 
might be argued that they are in danger of falling into a form of Papert's 
"human-superhuman fallacy" of attacking machine^ simulations because they do not 
perform superhuman tasks, like translate poetry, tasks that some peopla certainly 



can do. When such sceptics say that PARRY does not understand they have ^in 
mind a level of understanding that is certainly high - one could extend their 
case ironically by pointing out that very few people understand th*e content 
of sentence's in the depth and detail that an analytic philosopher does, and a 
very good thing too. But there can be no doubt that many people on many 
occasions DO seem to understand in the way that PARRY dojs. 

Simmons 

The remaining three systems differ from the two above in their atten5>t 
to provide some representational structure quite different from that of the 
English input. This means the use of cases # and of complex structures that 
allow inferences to be drawn from the attribution of case in ways I shall 
explain. There is also, in the remaining systems, some attenpt to construct 
a primitive, or reduced, vocabulary into which the language represented is 
squeezed. 

Simmons' work is often thought of as a "memory model", though he does in 
fact pay more attention to word sense ambiguity, and to actual recognition in 
text than do 
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many other authors. 



For him the fundamental no t ion is that 



of a 'semantic network', defined essentially by the statement 
of relational triples of form aRb, where R is the name of a 
relation and a and b are the names of nodes in the network. 
Simmons' work with this general formalism goes back to at 
least (Simmons et al, '66) but, in its newer form with case 
formalism, it has been report«^d since 1970 (Simmons '70b) i 
(Simmons and Bruce '71), (Simmons and Slocum '72), (Simmons 
'73) J and (Hendrix et al '73) may reasonably be considered 
a further implementation of Simmons' methods. 

Simmons considers the example sentence 'John broke the 
window with a hammer'. This is analysed into a network of 
nodes CI, C2 , C3, C4 corresponding to the appropriate senses 
of 'John', 'Break', 'Window' and 'Hammer' respectively. 
The linkages between the nodes are labelled by one of -the 
following 'deep case relations': CAUSAL-ACTANT (CAl, CA2), 
THEME, LOCUS, SOURCE and GOAL. Case relations are specifi- 
cations of the way dependent parts of a sentence, or concepts 
corresponding to parts of a sentence, depend on the main 
action. So, in this example, John is the first causal actant 
(CAl) of the breaking, the hammer is considered the second 
causal actant (CA2) of that breaking, and the window is the 
theme of the breaking. Thus, the heart of the analysis 
could be represented by a diagram as follows: 



•John' C2 

CAl 




' Break ' 
• CI 



CA2 



C4 



• Hammer • 



THEME 
•Window' C3 
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or by a set. of relational triples: 

(CI CAl C2) (CI CA2 C4) (Cl THEME C3) 
However, this is not the full representation, and my addition 
of the word labels to the diagram is misleading, since the 
nodes are intended to be names of senses of words » related 
to the actual occurrence of the corresponding word in a text 
by the relation TOK (for token) . In an implementation, a 
node would have an arbitrary name, such as L97, which would then* 
name a stored sense definition. So, for a sense of 'apple' 

Simmons suggests an associated set of features: NBR- 

singular (s) , S HAPE^spher ica 1 , COLOR-red, PRINTIMAGE-apple , 

THEME^eat, etc. If the name of the node tied to this set 

of features was indeed L97, then that node might become, 

say, C5 on being brought into some sentence repr«»enta t ion 

during parsing. Thus, 'the diagram I gave must be thought 

of supplemented by other relational ties from the nodes; 

so fehdt thp full sentence about John would be represented ^ 

by th^ larger §#t ©f tjrJiples: 

(Cl T0K )»r@dk) <C1 CAl C2) (Cl THEME C3) CCl CA2 C4 ) 
(C2 T0IC John) (C2 DET Def) (C2 NBR S ) 
(C3 TOK WindQW) (C3 DET Def) {C3 NBR S) 

(C4 TOK Hdmm§r) (C4 DET Indef ) (C4 NBR S) (C4 PREP With) 

Word sense amfetQM ity is taken account of in that the 

node for one s^f\^^ of 'hammer* would be different from that 

corresponding to some other sense of the same word, such as 

that meaning Edward, Hammer of the Scots, to take a slightly 

$ 

strained alternative for this sentence. 

The network above is also a representation of the fol- 
lowing sentences, which can be thought of as surface variants 



Simmons' normal example of word sense ambiguity does not 
apply to the sentence above: he distinguishes 'pitcherl', 
a pouring container, f rom 'pi tcher2 ' , in the U.S. sense of 



*one who bowls a ball'. 
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of a single 'underlying' structure: 

John broke the window with a hammer 

John broke the window 

The hammer broke the window 

The window broke. 

Not all parts of that network will be set up by each of these 
sentenres, of course, but the need for some item to fill 
an appropriate slot can be inferred; i.e. of the first causalactant 
(John) "in the last two sentences. The sentences above are 
recognised by means of the 'ergative paradigm* of ordered 
matching patterns, of which the following list ia a part: 

(CAl THEME CA2) 

(CAl THEME) 

(CA2 THEME) 

(THEME) 

These sequences will aach match, as left-right ordered items, 
on^of the above sentonces. It will be clear- that Simmons* 
method of ascribing a node to each word-sense is not in any ^ 
way a primitive system, by which I mean a system of classifi- 
ers into which all word senees are mapped. 

Simmons is, however, considering a system of paraphrase 
rules that would map from one network to another in a way 
that he claims is equivalent to a system of primitives. Thus 
in (Simmons 73) he considers the sentences: 
John bought the boat from Mary 
Mary sold the boat to John 

which would normally be considered approximate paraphrases 
of each other. He then gives 'natural' representations, in 
his system, as follows in the same order as the sentences: 

CI TOK buy, SOURCE (Mary), GOAL (John), THEME (boat), 
CI TOK sell, SOURCE (Mary), GOAL (John), THEME (boat), 
and also the single represent at ion for both sentences, as 
below, using a primitive action 'transfer' (see description 
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of Schank's work in next section) as follows: 



CI TOK and, Args C2, C3 

C2 TOK transfer, SOURCE (John), GOAL (Mary), THEME (money) 
C3 TOK transfer, SOURCE (Mary), GOAL (John), THEME (boat) 



Simmons opts for the first form of representation, given 
the possibility of a transfer rule going from either of the 
shallower representations to the other, while in (Hendrix 
et al '73), the other approach is adopted; using a primitive 
action EXCHiVKGE instead of 'transfer*. 

The imple»t«nti«tion under construction is a front-end 
parser of the Woods' augmented transition netwp»rk type 
(see Woods '70), and a generation system going from the sem- 
antic networks to surface strings described in detail in 
(Simmons and Slocum '72). Simmons has also given considerable 
time (Simmoas and Bruce '71) to the automatic translation 
of th^ MtvoatlCs iato a corresponding first-order predicate 
caklculus forMt of the sort developed by S^nd^v^ll (1971) • 
This l^st is pa^rticul^rly valuable because r if g^neralisable r 
it ahovs that any linguistic codings in network form can 
be translated into soaia forn of the predicate calculus, if 
that formalism and its associated proof techniques can be 

I f • :i 



natural language analysis. 

Schank 

Schank's is a rich system of semantic r epr esenta t ion , 
developed over a period of six years, with the collaboration 
of a number of talented students. Its graph"* system of nota- 
tion has influenced psychologists like Abelson (1973), among others. 
Schank's contribution has been the notational system represent- 
ing the structure of natural language sentences, and this 
has been programmed by various collaborators over the years. 



shown to be appropriate 
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In ixy> firt^soru v^^nzion, called MARGIE (Schank ot al '73) 
it has an analyser of English due to Riesbeck (1974), a 
semantic memory component due to Rieger (1074), and a gene- 
rator of English due to Goldman (1974). MARGIE produces 
output m two modes, demonstrating the sort of conceptual 

mferencing that goes on at the level of the semantic repre- 
$ 

sentation : the PARAPHRASE mode and the INFERENCE mode. 
Samples of input and output to and from the two modes can 
be shown thus : 

(INFERENCE MODE) 

INPUT: John told Mary that Bill wants a book. 
OUTPUT: A book dbout what. 

Mary knows that Bill wants a book. 

Bill wants to come to have a book. 

Bill wants someone to cease to have a book. 

Bill wants to read a boo k . 

( PARAPHRASE MODE) 

INPUT:; John killed Mary by choking Mary. 
OUTPUT: John strangled Mary. 

John choked Mary and she died because she could not breathe. 

Mary died because she was unable to inhale some air and she 
was unable to inhale some air because John grabbed her neck. 

The aim of Schank's system has always been to provide a 
representation of meaning in terms of which these and other 
tasks, such as ma chine translation, could be carried out} a 
representation, moreover, that was to be independent of any 



$ Schank distinguishes 'conceptual* and "semantic* represen- 
tations in a way that is impor tant for him within his own 
system. However, I shall use the terms indifferently since, 
in this brief and superficial description, nothing hangs upon 
the distinction. 



ERLC 



30 



particular languages, and of" syntax, and indeed^of all 

surface structure whatever, 
formal 

The^tructure of Schank's graphs is that of dependency 
grammar (Hays '64), and the items in the graph are of four 
types, or conceptual categories. They are symbolised as 
PP, ACT, PA and AA, which are acronyms, but which correspond 
closely (for the prupose of understanding their f unct ion ) 
to those of a noun, verb, adjective and adverb, respecti velyt 
The basic structure is called a conceptualisation , and is 
normally introduced 'with a straightforward dependency struct- 
ure such as, for the sentence 'The man took a book': 

P o 
Ma n^^^ take ^ book 

Here 'p' indicates past, and*o*is the dependency symbol linking a 
PP to the ACT ('take') which is the hub of the conceptualisation, 
as with Simmons. The 'o' indicates the objective case, marking 
the dependence of the object PP on the central ACT. There is a 
carefully constructed syntax of linkages between the conceptual 
categories, that will be described only in part in what follows. 

The next stage of the notation involves an extended case 
notation and a set of primitive ACTs, as well as a number of 
items such as PHYSCONT which indicate other states, and items 
of a fairly simplified psychological theory (the dictionary 
entry for 'advise', for example, contains a subgraph telling 
us that Y 'will benefit' as part of the meaning of 'X advise 
Y' (Schank '73)). There are four cases in the system, and 
their subgraphs are as follows: 

Objective case: ACTf-^ PP 

PP 



Recipient case: ACT ^ — 



PP 



*This is a considerable oversimplification, made in order to 
give a brief and self contained description. But, in fact, many 
English nouns are represented as ACT's: chair, pen, honesty, and 
O transportation. 

ERIC 
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Di receive C'TW: act ^1 
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There are at nresont f t t -mmi* l-a s w- „<Mio„>: fornnnu t 1.,^ ,Mibs 
of the graphs, as wiOl ,i a dc-fauli act ion no. Thoy aro: 
PROPEL, MOVE, INGEST, KXPKL, C;RASP, PTRAN.';, MTRAN.S, ATHAN.S, 
SMELL, SPEAK, LOOK-AT, MSTEN-TO, CONC and MIUIILD. Tho no- 
tions of case and pr i m i f i vo act aro related by rulos in the 
development of con cop tua 1 i sat i ons . So, for example, the 
primitive act INGEST has as its instrument the act PTRANS. 
There are also other inferences from any ACT classified as 
an INGEST action, such as that the thing ingested changes 
its form; that if the thing ingested is edible the ingester 
becomes 'more nourished' r-tc., (see Schank '73, pp. 38ff.). 
Thla will all>tJecome clearer if we condider the transition 
from d dictionary entry for an action to a fjlled-in con- 
ceptual i gat ion . Here is the dictionary entry for the action 



• shoo t* 



X<^> PROPKL, 4 hu) let <-!: 



Ill 



Y hurt 

We can consider this ontry as an active ' f ranio- 1 i kP • oh.iect 
seeking filler items in any cont.>xt-. in which it is activated. 
Thus, in the sentence- 'John-r.hot th.; girl with § rifle', the 
variables will be filled in f , om context and tho case in- 
ference will be made from the main act PROPEL, which is that 
its instrument is MOVE, GRASg or PROPkl, and so wo will arrive 
at the whole conceptualisation: 



* 



Since the publical >nn of (s<-h..nl / ) ti,.-,, numb.-, i,,,. i,...-„ 
reduced to eleven (plus no) by t - I , na t . <.r. >-l ::Mi.;i,i. li-.TKNTc^ 
LQDKAT and CUNC, and t h.' addition of ATTKNI). ^ 



rifle 

ir.l J 



ifj. 

ouiiec ill -<riflo 

. , ' t 

• bullet 

-^ 

I I 

rifle g iV 1 

This case inference must bo made, according to Schank, in 
order to achieve an adequate representation. There is, in 
the last diagram, a certain redundancy of expression, but 
as we shall see in the next section this often happens 
with deeper semantic notations. 

More recently, Schank, together with Rieger, has 
developed a new class of causal inferences which deepen the 
diagrams still further. So, in the analysis of 'John's cold 
improved because I gave him an apple' ttn Schank '74a) the 
extended diagram contains at least four yet lower levels 

« 

of causal arrowing, including one corresponding to the no- 
tion of John constructing the idea (MBUILD) that he wants 
to eat an apple. So we can see that the underlying explica- 
tion of meaning here is not only in the sonse of linguistic 
primitives, but in terms of a theor-y of mental acts as well. 

Now there are a number of genuine expositional difficulties 
here for the commentator faced with a system of this complex- 
ity, one aspect of this is the stages of development of the 
system itself , which can be seen as a consistent process of 
producing what was argued for in advance. For example, Schank 
claimed early on to be a constructing system of semantic structures 
underlying the 'surface of natural language', although 
initially there were no primitives at all, and as late as 
(Schank et al '70) there was only a single primitive TRANS, 
and most of the entries i i, the dictionary consisted of the 
English words coded, together with subscripts. Since then 
the primitive system has blossomed and there are now twelve 
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primitivos for ACTS incl-uding three 'for the original TRANS 
itself. Each exposition of the system recounts its preced- 
ing phases^ from the original primitive-free one, through 

f o r iL 

to the present causal inferonce^j rather as each human foetus 
is said to relive in the womb all the evolutionary stages 
of the human race. The only trouble with this, from an 
outsider's point of view, is that at each stage the represen- 
tation has been claimed, in firm tone^, to be the correct 
one, while at the same time Schank admits, in moments of 
candor (Schank '73), that there is no end to the conceptual 
diagramming of a sentence. This difficulty may^well reflect 
genuine problems in language itself, and^in its acutest form 
concerns a . thr(>e-way confusion between an attractive no- 
tation for displaying the 'meanings of words', the course 
of events in the real world, and, finally, actual procedures 
for analysis. It is not always clear whether or not pro - 
cedures implementing conceptual dependency are intended to 
recapture all the many phases of expansion of the diagrams/ 

This raises the, to me, important question of the ap- 
plication of a semantic system, that I shall touch on again 
later. Schank, for example, does mention in passing the 
questions of word-sense ambiguity, and the awful ambiguity 
of English prepositions, but they are in no way central for 
him, and he assumes that with the availability of 'the cor- 
rect representation'', his system when implemented must in- 
evitably solve these traditional and vexing questions. No 
procedures are liintod at along with the graphs as to how this 
is to be done. A distinction of importance may be becoming 
apparent here botwoiMi Schank's work and Rioijer's:, in Rieger's 
thesis (Rioger •7.1) the rules of inference appear to create 
separate and now sulxiraphs which may stand in an inferential 
relation to each other so as to produce conclusions about 
problems of, say, pronoun reference, etc. But in Schank's 



cor respond 1 ng pajx^rs t ho .same inforonroi; aro not applied to 
actual prol^icMas (Schatik 'V^la) but only conn>l(^xify the con- 
ceptual graphs; furtlicr. Closoly connoct(Mi with tliir- is fhe 
question of the survival of tho surface i?trut:turo in the dia- 
grams. Until very recently pr i m i t i v i sa t ion appli(»d only to 
verbs, that of nouns being left to Webor (Weber '12). Most 
recently, though, noun words have been disappearing from 
diagrams and been replaced by categories such as *PHYSOBS*. 
But it is clear that the surface is only slowly disappearing, 
rather than having been abhorred all along. 

In his most recent publication (Schank '74b) there are 
signs that this trend of infinitely proliferating diagrams 
is reversing. In it Schank considers the application of 
his approach to the representation of text, and concludes, 
correctly in my view, that the representations of parts 
of the text must be interconnected by causal arrows, and that, 
in order to preserve lucidity, the conceptual diagrams for 
individual sentences and their parts must be abbreviated, ' 
as by triples such as PEOPLE PTRANS PEOPLE. Here indeed, the 
surface simply has to survive in the representation unless 
one is prepared to commit oneself to the extreme view that 
the ordering of sentences in a text is a purely superficial 
and arbitrary matter. The sense in which this is a welcome 
reversal of a trend should be clear, because in the *causa- 
tion inference de velopmen t^ men t ion ed earlier, all the con- 
sequences and effects of a conceptualization had to be drawn 
within itself. Thus, in the extreme case, each sen tence 
of a text should have been represented by a diagram containing 
roost or all of the text of which it was a part. Thus the 
representation of a text would have been impossible on such 
principles. 
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Wilks 

My own system constructs a semantic representation for small natufll 
language texts: the basic representation is applied directly to the text and 
can then be "massaged" by various forms of inference to become as deep as is 
necessary for well defined tasks demonstrating understanding. It is a uniform 
representation^ in that information that might conventionally be considered as 
syntactic/ semantic ^ factual or inferential is all expressed within a single 
type of structure. The fundamental unit in the construction of this meaning 
representation is the template , which is intended to correspond to an intuitive 
notion of a basic message of agent-action-object form. Templates are rigid 
format networks of more basic building blocks called formulas , which correspond 
to senses of individual words. In order to construct a complete text represen- 
tation templates are bound together by two kinds of higher level structures 
called paraplates and inference rules . The ten5)lates themselves are built xxp 
as the construction of the representation proceeds, but the formulas, paraplates 
and inference rules are all present in the system at the outset and. each of 
these three types of pre-stored structure is ultimately constructed from an in- 
ventory of eighty semantic primitive elements , and from functions and predicates 
ranging over those elements. 

The system runs on-line as a package of LISP, MLISP and MLISP2 programs, 
taking as input small paragraphs of English, that can be made up by the user 
from a vocabulary of about 600 words, and producing a good French translation 
as output. This environment provides a pretty clear test of Ismguage under- 
standing, because French translations for everyday prose are either right or 
wrong, and can be seen to be so, while at the same time, the major difficulties 
of understanding programs - word sense ambiguity, case cimbiguity, difficult 
pronoun reference, etc. - can all be represented within a machine translation 
environment by, for example, choosing the words of the input sentence containing 
a pronoun reference difficulty so that the possible alternative references have 
different genders in French. In that way the French output makes quite clear 
whether or not the program has made the correet inferences in order to under- 
stand what it is translating. The program is reasoneODly robust in actual per- 
formance, and will even tolerate a certain amount of bad grammar in the input, 
since it does not perform a syntax analysis in the conventional sense, but seeks 
message forms representable in the semantic structures employed. 

3h 



Typical input would be a sentence such as "John lives out of town and 
drinks his wine out of a bottle. He then throws the bottles out of the 

4 

Window." The procjram will produce French sentences with different output 
for each of the three occurrences of "out of'\ since it realises that they 
function quite differently on the three occasions of use, and that the diffe- 
rence must be reflected in the French. A sentence such as "Give the monkeys 
bananas although they are not ripe because they are very hungry" produces a 
translation with different equivalents for the two occurrences of "they", 
because the system correctly realises, from what I shall describe below as 
preference considerations, that the roost sensible interpretation is one in 
Which the first "they" refers to the 
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bananas and the second to tho monkeys, and b^anas and nonkeys have 

different 'jundors m l*riM)ch. Thrr^o two oxamplcs arv doalt with in the 

(Wilk<; 73,1) 

"basic mode** of the system.^ Ir) nuiny casos it canno' resolve pronoun 
ambiguities by the sort of straiqhtforward "preforonec* considerations*' 
used in the last exampit*/ whoro, roiujhly speaking, "ripeness** prefers 
to be predicated of plant-like things, and hunger of animate things. 
Even in a sentence as simple as **John drank tho wine on the table and it 
was good*', such considerations are inadequate to resolve the ambiguity 
of *'it'* between wine and table, since both may be good things. In 
such caseSj of inability to resolve within its basic mode^ the program 



presentation of the text so as to try and set up chains of inference 
that will reach, and so prefer, only one of the possible referents. I 
will return to these processes in a moment, but first I shall give some 
brief description of the basic representation set up for English. 

For each sense of a word in its dictionary the program sees a formula. 
This is a tree structure of semantic primitives, and is to be interpreted 
formally using dependency relations. The main element in any formula 
is the rightmost, called its head, and that is the fundamental category 
to which the formula belongs. In the formulas for actions, for example, 
the head will always be one of the primitives PICK, CAUSE, CHANGE, FEEL/ 
HAVE, PLEASE, PAIR, SENSE, USE, WANT,* TELL, BE, DO, FORCE, MOVE, WRAP, 
THINK, FLOW, MAKE, DROP, STRIK, FUNC or HAPN. 

Here is the tree structure for t}\e action of drinking: 
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Onre agdin, it is not neconr.ary to explain the formalism in any 
detail, to see that this sonso at "drink*** is, -being expressed as a 
cdusiny to,irK)Vi. a li^Jiui obj(»ct (klX)W STUFF) by <in «inimato agcMit, into 
that same agent (cont*iinnu»nt. cusc* uulicatod by IN, and formula syntax 
identifies SELF with thr aqont ) and via (diroct.ion raso) an aporture 
(THRU PART) of the ncjrtit . 

Template structure's, which actually ropr(»S(»nt !;entx'ncos and their 
parts are built up as networks of formulas like ihc one abov(>. Tem- 
plates always consist of an acjont node, and action node and an obiect 
node, and other nodoi; that may de^pcnd on these, So, in building a 
template for "John drinks wine" ,^*tfie}a^ove^*t.ree- formula for "drinks" 
would be placed at the^ction node, another tree structure for Jchn afc 
the agent node and so on. The complexity of the system comes from the 
way in which the formulas, considered as active entities, dictate hov; 
Other places in the^emplato should be filled. 

Thus, the "drink" formula oIjovo can be thought of as an entity at 
a template action node, seeking a liquid object, that is to say a for- 
mula with (FLOW STUFF) as its right-most branch, to put at the object 
node of the same template. This seeking is preferential, in that 
formulas not satisfying that requirement will be accepted, but only if 
nothing satisfactory can be found. The template finally established 
for a fragment of text is tne one in which the most formulas have their 
preferences satisfied. There is a general principle at work here, 
that the right interpretation "says the least" in in format ion -carrying 
terms. This very simple device is able to do much of the work of a 
syntax and word-sense ambiguity resolving program. For example, if 
the sentence had been "John drank a whole pitcher", the formula for the 
'pitcher of liquid"would have been preferred to that for the human, 
since the subformula (PLOW STUFF) could be appropriately located within 
it. 

A considerable amount of squeezing of this simple canonical form 
of template is necessary to make it fit the complexity of language: 
texts have to be fragmented initially; then, in fragments which are, say, 
prepositional phrases there is a dummy agent imposed, and the preposi- 
tional formula functions as a pseudo-action. There are special "less 
preferred" orders to deal with fragments not in agent-action-object 
order and so on. 



When the local inferences have been done that set up the agent-action- 
object ifinnlattn^ tor tra^jnients of input .text, the system attempts to tie these 
tompldto:. loijfihor uo ris to provide an overall initial structure for the input. 
One form of this is the anaphora tie, of the sort discussed for the monkeys 
and bananas example above, but tlie more general form is the case tie. Assign- 
ment of these would result in the template for the last clause of "He ran the 
mile in a paper bag" being tied to the action node of the template for the 
first clause ("He ran the mile") and the tie being labelled CONTainment. These 
case ties are made with the aid of another class of ordered structures, 
essentially equivalent to Fillmore's case frames, called paraplates and which 
are attached to the formulas for English prepositions. So, for "outof", for 
exan^le, there would be at least six ordered paraplates, each of which if» a 
string of functions that seek inside templates for information. In general, 
paraplates range across two, not necessarily contiguous, templates. So, in 
analysing "He put the number he thought of in the tcible", tho successfully 
matching paraplate would pin down the dependence of the ten^late for the last 
of the three clauses as DIREction, by taking as argument only that particular 
template for the^,last clause that contained the formula for a numerical table, 
rather than a kitchen table*, and it would do that because of a function in 
that paraplate seeking a similarity of head (SIGN in this case) between the 
two object formulas, for "number" and "table". The other template containing 
the "furniture" formula for "table" would naturally not satisfy the function 
because SIGN' would not be the head of this sense formula for "table". 

The structure of nutually connected templates that has been put together 
thus far constitutes a "semantic block", and^if it can be constructed, then, as 
far as the system is concerned, all semantic and referential ambiguity has been 
resolved and it will begin to generate French by unwrapping the block again. 
The generation aspects of this work have been described in (Herskovits *73). 
One aspect of the general notion of preference is that the system should never 
construct a deeper or more elaborate semantic representation than is necessary 
for the task in hand and, if the initial block can be constructed and a gene- 
ration of French done, no "deepening" of the representation will be atten?)ted. 

However, many examples cannot be resolved by the methods of this "basic 
mode" and, in particular, ir a word sense ambiguity, or pronoun reference, is 
sti ' \ unresolved, then a unique semantic block of templates 
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cannot bo constructt^d and tho "oxtjjndod mode'* will bo ontorod* In this * 
mode^ new templato-liko fonm^ aro oxtractod from oxii^ting onos, and then 
added to the template pool from which further infcroncos can be made* 
So, in the template derivtHl earl i(^r for '*John drinks wine", the system 
enters the formula for 'Mr inks", and draws inferences corresponding to 
each case sub-formula* In this example it will derive template-like 
forms equivalent to, in ordinary English, "The wine is in John", "The 
wine entered John via an aperture" and so on* The extracted templates 
fe..press information already implicitly present in the text, even though 
many of them are partial inferences: ones that may not necessarily be 
true . 

Common-sense inference rules are tlien brought down, which attempt, 
by a simple strategy, to construct^*^^ shortest possible chain of rule- 
linked template forms from one containing an ambiguous pronoun, say, to 
one containing one of its possible referents. Such a chain then consti- 
tutes a solution to the ambiguity problem, and the preference approach 
assumes that the shortest chain is always the right one. So, in the 
case of "John drank the wine on the table and it was good"/ the correct 
chain to "wine'* uses the two rules 

I 1. ((*ANI 1)((SELF IN) (MOVE CAUSE) ) ( *REAL 2 ) ) ->{1(*JUDG) 2) 
or, in "semi-English", 

[animate -1 cause-to-movc-in-solf real -object- 23 — ^ [)- * judges 2j 
I 2. (1 BE (GOOD KIND)) <-> ( (*ANI 2) WANT 1) 
or, again, 

(l is goodj ^ [animate-2 wants l] 

These rules are only partia l, that ist they correspond only to what 
we may reasonably look out for in a given situation, not to what MUST 
happen. The hypothesis here is that understanding can only take place 
on the basis of simple rules that are confirmed by the context of 

application. In this example the cnain constructed may be expressed 
as jusing the above 'square bracket notation to contain not a repre- 

sentation^ but simply an indication^ in EnglishjOf the template contentsjl * 



*Wilks *13h ^and in press) 



forwards y 
inf. 



backwards 
inf ♦ 



[john drank tlu'-wn\»^J 

[john causu»*;-t o-iik>vo- i n-sol C wiiu*j 

[johu *judM»* ' wuu*] 

[johi) wants wino^ 

[wino ii> ^jooclj 

[?it is goodj 



Template 1 
T- Template 1 
by I I. 
^ line above 
by I 2. 
Template ^ 



The assumption here is that no chain using other inference rules could 
have reached the "table" solution by using less thact two rules. 

The chief drawback of this system is that codings consisting en- 
tirely of primitives have a considerable amount of both vagueness and 
redundancy* For example r no reasonable coding in terms of structured 
primitives could be expected to distinguish^ say^ "hammer" and "mallet". 
That may not matter provided the codings can distinguish importantly 
different senses of words. Again, a template for the sentence "The 
shepherd tended his flock" would contain considerable repetition, 
each node of the template trying, as it were, to tell the whole story 
by itself. Whether or not such a system can remain stable with a 
considerable vocabulary, of say several thousand words, has yet to be 
tested. 



It will be evident to any reader that the last two systems des- 
cribed, Schank's and my own, share a great deal in common. Even the 
apparent difference in notation is reduced if one sees the topological 
similarity that results from considering the head of a 
formula as functioning rather like a Schank basic action. If one 
thinks of the dependencies of the case subparts of a fprmula^not ar- 
ranged linearly along the bottom of a tree, but radiating out from the 
head in the center, then the two diagrams actually have identical 
topologies under interpretation. A difference arises in that the 
"filled-in entity" for Schank is the conceptualisation centered on the 
basic action, though for me it is the network of formulas placed in 
relation in a template, whore there is indeed a basic action, the head of the 
action formula, but there is also a basic --ntity in the agent formula 
and so on. Or, to put it another way, both what-is and what-is- 
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expected are represented m the tcMuplate;;: the agent formula represents 
tlie a^j(^fit , fur t»x<ifuplt', l)Ut tho Uiit-luuid part o'f* tho action formula also 
represents what acjorit. was t.»xpf^ctod t;r sought, as m t lie {*AN] SUBJ) sub- 
formula of the ''drink" l:ormul<u 

Although developed in isolation 'initially, these two systems have 
also influenced eacli otlier in niore recent years, probably unconsciously • 
For example, conceptual dependoiicy now emphasises the aqent-action- 
object format more than before, and is less "verb-centered" and timeless, 
while, conversely, my own system now makes mucli more overt use of rules 
of partial information than in it^ earlier versions. Again, both 
systems liave intellectual connections that go back before either gener- 
ation of AI systems. In my view^both these systems have roots in the 
better parts of the Computational Linguistics movement of the Fifties: 
in the case of Schank's system, one may think of the earlier systems of 
(Hays '4i^ ) and (Lamb ), and the arrow-structxired primitive system 
of (Farradene ) • In the case of my own system there are clear 

precedents m the (Parker-Rhodes ) system of classification and the 

early semantic structures of (Richens Gl ) and (Masterman *G\ ) ♦ In 
1961 the last author was arguing that "what is needed is a discipline 
that will study semantic message connection in a way analogous to that 
in which metmathematics now studies mathematical connection, and to 
that in which mathematical linguistics now studies syntactic connection", 
(ibid., D*3) 

This historical point raises a final one that is, I feel, of passing 
interest* There seem to be two research styles in this field: one is 
what might be called the "fully finished style", in which the work exists 
only in one complete form, and is not issued in early or developed ver- 
sions. The best example of this is Winograd's work* The other type, 
exemplified by all the other authors discussed here, to some extent, is 
the developing style: work which appears in a. number of versions over 
the years, one hopes with gradual improvements, perhaps in attempts to 

tackle a wider range of linguistic or other inferential phenomena. 

but oven . 

There are advantages to both styles,^ in the latter one knows that any 
proposed structure or system will^ in the end, be found wanting in the 
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balancei^ ot lanquacje, so it. can only bo a quofition of when one will have 
to abandon, it. Tlu> i nt ('r<'<; n ncj qut^stion, and oim^ wluch no answer 
could possibly bo qivau hcrv , \y> lusl: how far Lr> it worth pushing any 
given structural approach hoforo ^>tarting aqain from scratch? 

6 . SOME COMPARISONS A ND CONTRASTS 

In this section I shall compare and contrast, under some eight inter- 
connected headings, tho projects described m the body of the paper. 
This IS not easy to do, parMcularly wlien the present author is among the 
writers discussed, thougfi tliat is easily remedied by tho reader's making 
an appropriate discount. A more serious problem is tliat, at this stage 
of research in artificial intelligence and natural language, the most 
attractive distinctions dissolve on more detailed scrutiny, largely because 
of the lack of any precise theoretical statement in most, if not all, the 
major projects. Thete are those who think that it therefore follows that 
this is not the moment for any form of critical comparison in this field, , 
and that no more is needed than a "positive attitude" towards all possible 
projects. Only those who feel that, on the contrary, any time is as good^ 
as any other for the discussion of intellectual differences in the hope of 
progress, should read on. 

It must be admitted right away that the selection of projects dis- 
cussed above, like Winograd's distinction between first and second gene- 
ration systems, on which the selection was to some extent based, cannot 
be defended by any strict definitions: one that would, in this case, 
include all the projects described, and exclude all those of Winograd's 
"first generation". One might, for example, want to define second gene- 
ration systems (in the study of natural language within the AI paradigm) 
in some very general terms, such as those systems which, (1) contain com- 
plex semantic structures for the representation of text that are signifi- 
cantly different from the "surface structure" of the input, and (2) contain 
cognate structures representing conceptual and real world knowledge that 
is not explicitly present in the input text. Even so general a description 
of a "frames" type approach would not cover Charniak or Colby with the 
first point, nor Simmons with tho second^ for he has so far eschewed all 
concern with information not present explicitly in the input text. More- 
over the second point would certainly cover Winograd's own work, as well 



as Other first genoratiou cipproachos, r^o it is cloar^ at the outset of any 
compari soM^^that thcr<» i«; nol evoiT a siinplo and unequivocal definition 
which covers all and only the projects to be compared.. 

Level of Representation - 

One important line of current dispute among the second generation 
approaches concerns the appropriate level of ropreseritat Ion for natural 
language. On the one hand are those like Colby, and apparently Charniak, 
who hold ♦^h^^ representation of language can, in effect, be by means 

of itself while, on tiie otlier liand, there are those like 
Schank and myself who hold that the appropriate level of computation for 
inferences about natural language is in some reduced, or primitive, repre- 
sentation. Simmons, as we saw, holds an intermediate position. I 
wrote "appears" in the case of Charniak because he holds that his struc- 
tures are independent of any particular level of representation, or 
rather^ that^^^^ou Id be realized at a number of levels of representation, 
depending on the subject area. However, there is no doubt that the 
representation in terms of predicates that he offers in his work appears 
to be in one-to-one correspondence with English words. 

The strongest low-level approach is undoubtedly that of Colby, who 
straightforwardly faces the enormous mapping problems involved if the 
structures are at the English word level. It is important to realize that 
this dispute is ultiiM.Url/ ot • fji degree, since no one would claim that 
every locution recognized by an intelligent analyser must be mapped into 
a "deep" representation. To take an extreme case, any system that mapped 
"Good Morning" into a deep semantic representation before deciding that 
the correct response was also "Good Morning" would be making a serious 
theoretical mistake. 

However, the most serious argument for a non-superficial representation 
is not in terms of the avoidance of mapping difficulties, but in terms of 
theoretical perspicuity of the primitive structures, and this argument is 
closely tied to the defence of semantic primitives in general, which is a 
large subject not to be undertaken here. One of the troubles about seman- 
tic primitives is that they are open to bad defenses, which decrease rather 
than increase their plausibility. For example, some users of them for 
linguistic representation have declared them to have some sort of objective 
existence, and have implied that there is a "right set" of primitives open 
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to empirical discovery. On t iiat viov/ the essentially linguistic 
character of structure's* pr inn 1 1 vos is lost, 'fin- t hoy then might as 
well bo strings of bwiciry nunihor:;, or soiiiothinq e(]ually opaque and non- 
linguistic. No qreat 'Jucil of th(;\Kjht is r(V]uirod to see that that 
simply could not be th(^ case.: What is t.he case is tlial there is a 
considerable anjount ot psyrjiiuloqical evuience that people are able to 
recall the content of what they hoar and understand without being able 
to recall either the actual words or the syntactic structure used. 
There is large literature on this subject, from which two sample re- 
ferences would be (Wt>ttler '73) and (Johnson-Laird '74). 

These results are, of coursi*, no proof of the existence of semantic 
primitives, but they are undoubtedly supporting evidence of their plausi- 
bility, as is, on a different plane, the result from the encoding of the 
whole Webster's Third International Dictionary at Systems Development 
Corporation, where it was found that a rank-ordered frequency count of the 
words used to define other words in tliat vast dictionary was a list 

(omitting "the" and "a") whicli corresponded almost item-for-item to ^ 
a plausible list of semantic primit ives^ derived a priori^ by those actually 
concerned to code the structure of word and sentence meanings, ^ 

It IS important to distinguish the dispute about level from the^ 
closely connected^ topic that I shall call the centrality of the knowledge 
required by a language understanding system. 

Central ity 

Wliat I am calling the centrality of certain kinds of information 
concerns noL its level of representation but its non-specificity: again 
a contrast can be drawn between the sorts of information required by 
Charniak*s system^ on the? one hand^ and that required by Schank's and my own 
on the other. Charniak's examples suggest that the fundamental form of 
information is highly specific* to particular situations, like parties and 
the giving of presents, wliile the sorts of information central to Schank*s 
and my own systems are general partial assertions about human wants, 
expectations, and so on, many of which are so general as to be almost 
vacuous which/ one might ar^jue, is why their role in understanding has 
been ignored for so long . 

* In Charniak*s most recent pap(^r (1074), he gives mucli more general rules, 
such as his "rule of significant 5>ub-act ion" , mo^t i ontvi e<irller. 



If i wor^* a ro<u;ondbly fluent Kpoak*er of, say, German, I might 

well not urulrrstanil a Gt^nnan corivor^at ioti about birthday presents unless 

I had detailed factual mfonnat i<;n alxjut" how CU^nnanr; orqaniza the giving 

of presents, which might- be coiuudt^rably different- I rem the way wo do it. 

Conversely, of course, I might urui(^ri?tancl much of a t-cchnical article 
I 

about a subject in which T was an export-, even though 1 know very little 
of the language in which it wa*; written. These are certainly considerations 
that tell for Charniak's approacli, and Jt is perhaps a paradox that the 
sort of natural language undorstandor that would tend to confirm his assump- 
tions would be one concornod with di^courr^e about", say, the details of 
repairing a motor car, whore factual information is what is central^ yet, 
ironically, Charniak has concentrated on something as general as children's 
stories, with their need of deep assumptions about human desires and be- 
hav iour . 

In the end this difference may again turn out to be one of emphasis, 
and of what is most appropriate to different subject areas, though there 
may be a very general issue lurking somewhere here. It seems to me not ^ 
a foolish question to ask whether much of what appears to be ^bQwt natUi^al 
language in A.I. research is in fact about language at all. Even if it is 
not that may in no way detract from its value. Newell (Moore, Newell •73) 
has argued that A.I. work is in fact "theoretical psychology", in which 
case it could hardly be research on natural language • When describing 
Wmograd's work earlier m the paper^ I raised this question in a weak form 
by asking whether his definition of "pickup" had anything to do with the 
natural language use of the word, or whether it was rather a description 
of how his system picked something up, a quite different matter. 

Suppose we generalize this query somewhat, by asking the apparently 
absurd question of what would be wrong with calling, say, Charniak's work 
an essay on the 'Socio-Kconomic Behaviour of American Children Under Stress?' 
In the case of Charniak's work this is a facetious question, asked only in 
order*" to make a point, but with an increasing number of systems in A.I. 
being designed not essent.ially to do research on natural language, but in 
order to have a natural lanauage "front end" to a system that is essentially 
intended to predict chemical spectra, or play snakes and ladders or what- 
ever, the question becomes a serious one. It seems to me a good time to 
ask whether we should expect advance in understanding natural language 
O from those tackling the problems head on, or those concerned to build a - 
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"front end". It is eltjatly the case that any piece of knowledge whatever 
could bf fssiMitial tt) Iht.' uiKU,'rstarid incj o£ some' story. The question is*, 
does It follow that tUo spocj f icat ion, organization and formalization of 
that knowledge is the study of lanquaqo, because if it istiien all human 
enquiry from physics and-lustory to niodicine i 55 <\ linqtM-Uic enterprise. 
And, of course, that possibility han actually been entiortained within 
certain strains of modern philosophy. 

a 

However, I am not trying here to breathe fresh life into^hiloso- 
phical distinction, between boing about language and not being about 
language, but rather introducing a practical distinction, (which is also 
a consideration in f 1/ >i.r ot opting, as I have, to work on very general 
and central areas of knowledge) between specific knowledge, and central 
knowledge without which a system could not be said to understand the 
language at all . For example, I might know nothing of the arrangement of 
American birthday parties, but could not be accused of not understanding 
English even though I failed to understand some particular children's 
story. Yet, if I did not have available some very general partial in- 
ference such as the one people being hurt and falling, or one about people 
endeavouring to possess things that they want, then it is quite possible 
that my lack of understanding of quite simple sentences would cause obser- 
vers to think that I did not understand English. An interesting and 
difficult question that then arises is whether those who concentrate on 
central and less central areas of discourse could^ in pri nciple^ weld their 
bodies of inferences together in -h a way as to create a wider system); 

whether, to put the matter another way, natural language is a whole 
that can be built up from parts: 

Phenomeno logical level 

Another distinction that can be confused with the central-specific 
one is that of the "phenomenological levels" of inferences in an under- 
standing system. I mean nothing daunting by the phrase: consider the 
action eating which is, as a matter of anatomical fact, quite often an 
act of bringing the bones of my ulna and radius (in my arm) close to that 
of my lower mandible (my jaw) . Yet clearly, any system of common sense 
inferences that considered such a truth when reasoning about eating would 
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be making a mistake. One might say that the phenomenological level of the 
analy.si.. waV, wroluj cwon though all the inferences it made were true ones. 
The same wguld bo true of any A I system that made everyday inferences about 
physical objects by considering their quantum structure. 

Schank's analysis of eating contains the information that it is done by 
moving the hands to the mouth/ and it might be argued that even this is going 
too far from the "meaning" of eating, whatever that may be, towards generally 
true information about the act which, if always inferred about all acts of 
eating, v;ill carry the system unmanageably far. 

There is no denying that this sort of information might be useful to 
have around somewhere^ that, in Minsky's terms, the "default" value of the 
instrument for eating is the hand brought to the mouth, so that, if we have 
no contrary information, then that is the way to assume that any given act of 
eating was performed. Nonetheless, there clearly is a danger, and that is all 
I am drawing attention to here, of taking infererences to a phenomenological 
level beyond ^jiat; of common sense. A clearer case, in my view, would be 
Schank's analysis (1974a) of mental activity in which all actions, such as 
kicking a ball, say, are preceded by a mental action of conceiving or deciding 
to kick a ball. This is clearly a level of analysis untrue to common senee, 
and which can have only harmful effects in a system intended to mimic common 
sense reasoning and understanding. 

Decoupling 

Another general issue in dispute concerns what I shall call decoupling , 
which is whether or not the actual parsing of text or dialogue into an "under- 
standing system" is essential. Charniak and Minsky believe that this initial 
"parsing" can be effectively decoupled from the interesting inferential work 
and simply assumed. But, in my view, that is not so, because many of the later 
inferences would actually have to be done already, in order to have achieved the 
initial parsing. For example, in analysing "He shot her with a colt", we 
cannot ascribe any structure at all until we can make the inference that guns 
rather than horses are instruments for shooting, and so such a sentence cannot 
be represented by an " mference-but-no-parsing" structure, such as (AT JOHN 
STATION) , witJiout assuming that language does not have one of its essential 
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character li^tici;, namely systematic' ambiguity ^ If one allows representational 
..t ruct.uro.> to havt^ sujnificanco quite irldependent of their application, then 
one may not bo in a Lntuation essentially different from that of the logician 
who simply asserts that such-and-such is the *'right structure" of some sentence. 



The infer<»nc(»s r^HjuirtHl to resolvo, word sense aml^iguities, and those 



roquitfij to rt*.;olv<» juvMiuun rofftcMicc* problonis , *firo wot of different types? 



often tho two ptobltMm; occur in a sinqh^ i;entcnco and must bo resolved to- 
gether. But Charniak's decoupliiuj has; the effc^ct oi completely separating 
these two closely related linguistic phenomena in wliat, sooms t^ me an un- 
realistic manner. Mu*. system does^ inferencimj to resolve pronoun ambi- 
guities, Willie sense ami:>icjuity is presumably to be done in the future by 
some other, ultimately recoupled, system. 

Another way of pointincj up the difference between the attitudes of 
second generation systems to decoupling, in relation to the first generation, 
IS by describing tlie role of syntax analysis in tliem. As we saw, syntax 
was the heart of Winocjrad's system, but both levels of frame approach dis- 
count syntax analysis^, though for very different reasons: Charniak does so 
because it is part of the initial parsing from which his inferential work 
has been decoupled. Schank and I do so because we believe semantic analysis 
to be fundamental, and that in an actual implementation the results of 
syntactic analysis can all be achieved by a sufficiently powerful semantic 
analyser. And this last assumption is confirmed by the limited degree of 
success that the two semantic analysers have actually achieved in operation. 

Availability of surface structure 

An issue close to that of the appropriate level of representation in 
a system is tliat of the availability of the surface structure of the language 
analysed; or, to put it more crudely, the availability during subsequent 
analysis of the actual words being analysed. These are clearly available 
in Colby, and are indirectly available in Simmons, Winograd^J and my own 
system, but Schank makes a point of the importance of their non-availcd^ility , 
on the grounds that an ideal representation should be totally independent 
of the input surface structure and words. There are, both theoretical aind 
practical aspects to this claim of Schank 's: in the limit, the order of 
the sentences of a text is part of its surface structure, and presumably it 
is not intended to abandon this "superficial information". In one of his 
recent papers (1974b) Schank seems to have accepted some limitation on the 
abandonment of surface structure. 



The other, practical^ point concerns the form of representation em- 
ployed: m the (1973) implementation of Schank 's system using an analyser 




'^Although Charniak would argue that sense ambiguity could be introduced 
into his system in its present form, . , 



of input toxtf a memory and a aoncrcitor of responses, it was intended that . 
notluuii fOiouia bo tian:;forred from the input program to the output program 
except' a t oprosontation coded m the structures of primitives discussed 
earlier*. The question that arises is, can that structure specify and 
distinguish word-senses adequately without transferring information speci- 
fically associated with the input word? Schank clearly believes the 
answer to this question is yes, but that cannot be considered established 
by the scale of computations yet described in print. 

A suitable environment in which to consider the question is that of 
translation from one language to another: suppose we are analysing a sen- 
tence containing the word **nail**, meaning a physical object. It is clear 
that the translation of that word into French should not be the same as the 
translation for "screw** or "peg". Yet is it plausible that any description 
of the function of these three entities e ntirely in terms of se mantic Pri- 
mitives, and without any explicit mention of the word name and its connection 
to its French equivalent, will be sufficient to ensure that only the right 
match is made? 

Application 

This point is a generalisation of the last two, and concerns the way in 
which different systems display, in the structures they manipulate, the 
actual procedures of application of those structures to input text or 
dialogue. This is a matter different from both that of the availability 
of the surface structure, and of a computer implementation of the system. 
In the case of Colby •s patterns, for example, the form of their application 
to the input English is clear, even though the matching involved could be 
achieved by many different implementation algorithms. In the case of my 
own system, I hold the same to be true of the tem'^late structures, even 
though by the time the input has reached the canonical template form it 
is considerably different from the input surface structure. The system at 
the extreme end of any scale of perspicuity of application is Winograd*s, 
where the procedural notation, by its nature, tends to make clear the way 
in which the structures are applied. At the other end are the systems of 
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* This point is to some extent hypothetical since, as we saw, Schank *s 
conceptualizations still do contain, or appear to contain, many surface 
items; in particular nouns, adjoctives and adverbs. However, this is 
a transitional matter and they a*-e in the course of replacement, as 
noted, by non-superficial items. O 



Schank and CharniaK, whore no ai)rl ><^<'^tion is si^'Cified, which means that 
Uu' ropi-fsontat lorr. an* not only compatible *witli many implementation 
algorithnu;, which does not matter, but arc also compatible with many systems 
of linguistic rules, whose specification is an es55ontial piece of inquiry, 
and whose subsequent- production may cause the basic system to be funda- 
mentally different. 

English prepositions will serve as an example: in Schank's case 
notation there is no indication of how the case discriminations 

are actually to be applied to English prepositions in text. So, for 
example, the preposition "in" can correspond to the containment case, time 
location, and spatial location, among others. As we saw earlier, the 
discrimination involved in actual analysis is a matter of specifying very 
delicate semantic rules ranging over the basic semantic structures employed. 
Indeed, the structures and case system themselves seem to me to be essentially 
dependent on the nature and applicability of such rules*, and so this appli- 
cation of the system should have an obvious place in the overall structures. 
It is not something to be delegated to a mere "implementation". If enough 
of the linguistic intractables**of English analysis were to be delegated 
out of the representation^ A.I. would be offering no more to the analysis of 
natural language than the logicians who proffer the predicate calculus as a 
plausible structure for English. 

In some of his more recent writings Winograd has begun to develop a 
view that is considerably stronger than this application one: in his view 
the co ntrol structure of an understanding program is itself of theoretical 
significance, for only in that way, he believes, can natural language pro- 
grams of great size and complexity remain perspicuous. 



* This is not meant to be just bland assertion. I have written at some 
length on the relations between application and the theoretical status of 
linguistic theories in (Wilks *74). 

** The differences between Minsky's (1974) notion of "default value" and 
what I have called "preference" can be pointed up in terms of application. 
Minsky suggests "gun" as the default value of the instrument of the action 
of shooting, but I would claim that^ in an example like the earlier "He shot 
her with a colt", we need to be able to see in the structure assigned 
whether or not what is offered as the apparent instrument is in fact an 
instrument and whether it is the default or not. In other words^we need^^^ 
sufficient structure of application to see not only that "shooting' prefers 
an instrument that is gun, but also why it will choose the sense of "colt" 
that IS a gun rather than the one which is a horse. 

^v^VHayes (1975) has argued the same point, in a quite different form, nith his 
claim that Rieger^s (1974) program provides a "semantics" for Schank s work. 
It is interesting to note that this claim is a change from Hayes' earlier 
(1974) demand for a Tarskian semantics for language systems,' 



Fo r w«i r V i m f o r n c« ^ ^ 

Another out.st aiuiiibj Umpute c;o!icorns whothor one should make massive 
forward \nt'ereijces as one goos t.hroucjh a text, keeping all one's expect- 
ations intact, as Charniak and Schank hold, or whetlier, as I hold, one 
should adopt some 'laziness hypothos is" about understanding, and generate 
deeper inferences only when the system is unable to solve, say, a refer- 
ential problem by more superficial methods. * oVkc^ <re../*\S^ sUo^Ici 
^<xca^.> v^.-c<;-c; <,-lSV-t^ be. ^o- cAca\^o- ^c:ir.^<^. 

Although Scliank sometimes vrites of a system making "all possible" 

inferences as it proceeds tlirough a text, this is not in fact the heart 

of tlie dispute, since no one would want to defend any strong definition of 

the term "all possible inferences". Charniak's argument is that, unless 

a 

certain for v^^y^ ^^ jorovict*^ are made during an analysis of, say,^story ^ 
forward inferences, tliat is, that are not problem-driven? not made in 



response to any particular problem of analysis then known to the system 

then, as a matter of empirical fact, the system will not in general be 
able to solve ambiguity or reference problems that arise later # because 
it will never in fact be possible to locate (while looking backwards at 
the text/ as it were) tlie points where those forward inferences ought to 
have been made. This is, in very crude summary # Charniak 's case against 
a purely problem-driven inferencer in a natural language under stander . 

A difficulty with this argument is the location of an example of text 
that confirms tJ\e }x)int in a non-contentious manner. Charniak has found 
an excerpt from a book describing tlie life of apes in which it is indeed 
hard to locate the reference of a particular pronoun in a given passage. 
Charniak *s case is tiiat it is only po^3sihle to do so if one has made certain 
(non-problem occasioned) inferences earlier in the story. But a number 
of readers find it quite hard to refer that particular pronoun anyway, 
which might suggest that the text was simply badly written. 

Tins is a difticult matter about wliich to be precise: it would be 
possible, for example, to agree wit!) Cl)arniak*s argument and still construct 
a purely problem-driven infereiicer on ttic ground that, at the moment, this 
is tiie only way one can cope witli the vast majority of inferences for under- 
standing, since any system of inferences ma de in response to no particular 
problem m the text;, is too hard to control in practice. Indeed^ it is 
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noticeable that the most recent paporr> of SchankO-^^^^ and 1974b) and 
Charniak (1*)7.1) havt* ham corji; idi»r.ihly less- forward- inference oriented 
than yarl it»r unos*. 

This dispute is perhaps, only one of doqreo, and about the possibility 
of defining a degree of forward infVronce that aids the solution of later 
semantic problems without going into unnecessary depth**. This might be 
an area where psychological inve5;t iqations would be of enormous help to 
workers in A.I. 

The justification of <^ys terns 

Finally, one might usefully, though briefly, contrast the different 
modes of justification implicitly appealed to by the systems described 
earlier in this paper. These seom to me to reduce to four: 

(i) In terms of the power of the inferential system employed. 
This form of justification has underlain the early predicate calculus- 
based language programs, and is behind Hayes* (1974) recent demand that 
any formalism for natural language analysis should admit of a set theor* 
etic semantics, in the Tarskian sense, so as to gain "intellectual res* 
pectability"^ as he puts it. The same general type of justification is ^ 
appealed to in some degree by systems with PLANNER-type formalisms. 

(ii) In terms of the provision and formalisation, in any terms in- 
cluding English, of the sorts of knowledge required to understand areas 
of discourse. 

(iii) In terms of the actual [ierforniance of a system, implemented 
on a computer, at a task agreed to demonstrate understanding* 

(iv) In terms of the linguistic and/or psychological plausibility 
of the proffered systc>m of representation. 

Oversimplifying considerably, one might say that Charniak 's system appeals 
mostly to (ii) and somewhat to (i) and (iv);' Winograd's to (iii) and 

forward 

♦ A particularly interesting withdrawl of a strong /inference thesis is 

hidden away on p. 283 of (Riegor '74), but ha.s been located by the keen 
eye of E. Charniak 

** which may be no more than a psycliologica ' restatement of what us ed to 
be called (Hayes '71) (Sandewall '72) the 'frame problem*, r-' / ' • 
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sonu^wlial to the ol\xor {\\rco catecjoriosj .Colby *s (as regards its natural 
iaiujuaij*'^ t athoi Miaii pt;ychlaLfic^ aj^pocty ) appeals almost entirely to 
(iii) J Simmons largely to (iv), and Schank's and my own to differing 
mixtures of (li) , (iii) and (iv) . 

In the end, of course, only (iii) counts for empiricists^ but there 
is considerable difficulty in getting all parties to agree to the terras 
of a test*. A cynic might say that, in the end, all these systems analyse 
the sentences that they analyse or, to put the same point a little more 
theoretically, there is a sense in which systems, those described here and 
those elsewhere, each define a natural language , namely the one to which 
it applies. The difficult question is the extent to which those many 
and small natural languages resemble English. 



7. CONCLUSION 

The last section stressed areas of current disagreement, but there 

would, if votes were taken, be considerable agreement among A.I. workers 

on natural language about where the large problems of the immediate future 

are: the need for a good memory model has been stressed by Schank (1974a)^ 

and many would add the need for an extended procedural theory of texts, 

rather than of individual example sentences, and for a more sophisticated 

a 

theory of reasons, causes, and motives for use in yth eory of understanding. 
Many might also be persuaded to agree on the need to steer between the 
Scylla of trivial first generation implementations and the Charybdis of 
utterly fantastic ones. By the latter, I mean projects that have been 
seriously discussed^ but never implemented for obvious reasons, that would, 
say, enable a dialogue program to discuss whether or not a participant in 
a given story '*felt guilty", and if so why. 



* Though an interesting, and potentially revolutionary, distinction seems 
to have been introduced by a recent reviewer of many of the systems dis- 
cussed here, between the functioning of a program and a "program in itself": 
"Only Winograd describes a program that is sufficiently impressive in itself 
to force us to take his ideas seriously. The techniques of the others have 
to get by on whatever intuitive appeal they can muster". (Isard '74) 

5r, 



The last disoast* has sonu^t liii(\s as a major symptom an extensive 
ust* of till* word ••praqiuat ic s'* (thouqh tlu<' can vVl^so uulicato quite benign 
conditions lu othot cases); alonq with tUo implicit claim that "semantics 
has been solved, so wt^ i^hould -qor on with the pragmatics*'. It still 
needs repeating that t hcr^.■ is ruj s^Mise what.over in which the semantics of 
natural language has boon ^'olvod. It is ntill the onorn)ous barrier it 
has always been, oven if a few donts in its r»urfac(* are h(»ginning to appear 
here and there. Even if wo stick to tlio simplest examples, that present 

no difficulty to the human reader and it must be admitted that it has 

been one of the persistent faults of the A.I. paradigm of language that 
it has spent too much time on puzzles oxamples-~ there are still great 
difficulties both systematic and linguistic. 

An example of the former would be the development of a dynamic system 
of understanding texts oi stories that had any capacity to re- 

cover after having its oxpoctatioii ; satisfied and then, subsequently, frus- 
trated. At present no system of the sort described, whether of demons, 
preference or whatever, has any such capacity to recover. The situation, 
is quite different from that in a dialogue, as in Winograd's system^ where, 
on being given each new piece of information^ the system checks it against^ 
what it knows, to see if it is being contradicted, and then behaves in 
an appropriately puzzled way if it is. In frame or '*(?xpectation'* systems 
It IS all too easy to construct apparently trick, but basically plausible, 
example^; that satisfy what was being looked for and then overturn it. That 
possibility is already built into the notion of frame or expectation. 
An example of Phil Hayes against my own system will serve: consider "The 
hunter licked his gun all over, and the stock tasted especially good". 
What IS meant by "stock" is- clearly the stock piece of the gun, but any 
preference system like mine that considers the two senses of "stock", and 
sees that an edible, soup, sons(^ of stock is the pref(?rred object of the 
action "taste", will infallibly opt for the wrong sense. Any frame or 
expectation system is prone to the same general kind of counter-example. 

In particular cases like this it is easy to suggest what might be 
done: here we might su(jgost a preference attached to the formula for any- 
thing that was essentially part of anoth€^r thing (stock = part of gun' in 
this case) , so that a local scarcli was made- whenever the "part-of" entity 
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was mentioned, and thc^ <^ati sfact. ion of that search would always be the 
<^vi»rr i<i uu] prt^Lei enee . But that is not tliQ.saino as a general solution 
to the ptobleni, whiclt used to b(^' cviliod tliat of "topic*' in the comput- 
ational semantics of the Fifties. There are no solutions to this problem 
available here and now, though some suggestions have been made by 
Abelson (1974) and McDermott (1074). 



Systems like Charniak*s are^ as we saw, concerned with specific rather 
than conceptual information^ but there are quite simple "semantic speci- 



system devoted to the handling of facts ^ as can be seen by contrasting the 
sentences: 

The deer cJame out of the wood. 

Tiie grub came out of the wood, 

where we might safely assume that readers would assign quite different 
senses to "wood" m the two cases simply on the basis of the two different 
agents. No-one, to my knowledge, has suggested any general method for 
tackling such elementary examples. 

But, to finish on the bright side, it is important to stress that 
there is indeed an A. I. paradigm of language understanding in existence? 
one that embraces fvrst and second generation approaches, and which goes 
back, I suggested, to a considerable amount of earlier work in comput- 
ational linguistics. It can be distinguished by a catalogue of neglect 
by conventional linguistics that can be summarised under three heads: 

(i) theories of language must have procedural application to the 
subject matter that could in principle result in computer application and 
subsequent empirical tost. « 

(ii) theories of language must deal with it in a communicative con- 
text, one amenable to empirical assessment. Merely sorting, as generative 
theories were desujned to do, is not enough. 

(iii) theories of language must also be, in a clear sense, theories 
of the formalisation and organization of knowledge. If they are not 
then we can know m advance that they can never tackle the problem of 
language understanding. 

* One of the v^ry few acknowledgements of this fact, of the possibility 
of an A.I. paradigm of language, from a linguist is (Fillmore *74). 




ficity" problems that 



one .could 



to be tackled even in a 



not reasonably expect 



Till . f .ipt'i lur^ iMM'h<ipi> i>voi oiiiplura - 10^1 ar(Ms oi' (Hsagroement and 
^h:,{'atjr», .jiki undouhtrdly m«3ny ot th*\so disput<\s will come to be seen as 
no more than mothodoioqica I qiu^-.t. ions , or dL:5pulos about matters of emphasis 
and degree. But sonic arc, I fool suro, quostion':; of substance and it 
should bo possible to see in the reasonably near future whether one approach 
on any glvoa question is right and anothor wrong. It would be nice if 
this wore to bo settled by computation rather than l)y another change of 
fashion. 
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In ordor to compress tho reroronco list the following 
abbreviations foi ^-o I I ec t, i on s of a r t i c 1 s will he used. 

AIJC3 Advanced papc^rs of the Third International Joint 
Conference on Artificial I n t o i 1 1 go n co , -Stanford , 
Calif. 1973. 

AI.SB Pi'oceedmqs of the Summer Conference of the Society 

for Artificial Intelligence and Simulation of Behaviour^ 

University of Sussex. 1 9 / «1 . 
TEDD Proceodinqs of tin? Fifst International Conference on 

Machine T ra n s 1 a t ion / Na 1 1 ona 1 Pliysical Laboratory, 

Teddington, 19(^1 (HMSO, London, 19()1). 
ACL Proceedings of the Confercince of the Association for 

Computational Linguistics, Amherst, Mass. 1974. 
CAST Memoranda from tlie Istituto per gli studi Semantici e 

Cognitivi, Castagnola, Switzerland. ^ 
MITAI Memoranda from the Artificial Intelligence Laboratory, 

Mas sachusse t ts Institute of Technology . 
SUAIM Memoranda from the Artificial Intelligence Laboratory, 

Stanford University, Stanford, Calif. 
SRITN Technical notes from the Stanford Research Institute, 

Men lo Pa r k , Calif. 
MOD Papers in Compu t er Mode 1 of Though t and La nguage , 

ed. by Schank and Colby, (Frooman, San Francisco, 1973). 
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(Fi 1 Imoro • /4 ) . 

Fillmoro, C., Luinunoi .'School iiuturos, Univorsjty of Pisa, Italy. 
(Herskov I t s ' / U 

Herskovit^., A./IMk^ q < • ii r a t i d n ol French t i oni a sonant ic represen- 
tation, SUA I M- ' 1 . 

(Isard *7A) 

Isard, S., revit»w of MOD, i nro , Vol. HU> . 
( Job»nson-La I td '74) 

Joh nson- La I rd , P., Moniory for words, N a t ii r o , Vol.253. 
(Mmsky ' 74 ) 

Mlnsky, M., Kr aino sy s t(^ms , u n p u h> 1 i s h (? d M S S . , from Massachusetts 
Institute of TtM:htioloyy . 

(Wettler ^73) 

Wettler, M., '/.ur Speichorung syntak ti scher Merkmale im Langzeitge- 
dachtnis, Bericht ube^r df^n JB, Konress dor Deutschon Geseltschaft f . 
Psycho log le . 

(Hayes *7S) 

Hayes. P., Computer programming as a cognitive par ad igin , Na t ur e , 
Vol. 2 54. 
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(Abelson '13) 

Abolson, R. P., Tho .Structure 61* Belief Systems, in MOD. 
(Abel iu^n * 74 ) 

Abelson, R. P., Discourse lloador^,, to appear in Papers in 
Memory of J. Carbonell . 

(Balzer et al * 74)' 

Balzer, R. et al, Doma m- Independent Automatic Programming, 
use/Information Sciences Institute, Marina del Rey, Ca. 

(Bobrow • 68) 

Bobrow, D. G., Natural Language Input for a Computer Problem- 
Solving System, in Minsky (ed.). Semantic Information Processing 
(MIT Press, Cambridge, Mass. 1968). 



( Brown • 74 ) 

Brown, G. , Tho Believer System, in ACL. 



(Bruce '12) 

Bruce, B. , A Model for Temporal References and its Application 
in a Question Answering Program, in Artificial Intelligence 3 . 

(Bruce, Schmidt *74) 

Bruce, B. , Schmidt^ C.F., Episode Understanding and Belief 
Guided Parsing, m ACL. 

(Charniak '72) 

Charniak, E., Towards a Model of Children's Story Comprehension, 
MITAI-TR 2b6. 

(Charniak '7 3) 

Charniak, E., Jack and Janet in Search of a Theory of Knowledge, 
in AIJC3. 



(Charniak '74) 

Charniak, E., *'He will make you take it back**: A Study in the 
Pragmatics of Language, CAST No. 5. 

(Chomsky *57) 

Chomsky, N., Syntactic Structures , (Mouton, The Hague, 1957). 
(Colby, Parkison *74 ) 

Colby, K. M. , Pai ';ison, R. C, Pattern-Matching Rules for the 

Recognition of Natural Language Dialogue Express ions, 

in American Journal of Computational Linguistics ^ Vol. 1, No. 1. 

(Colby, Hilf *73) 

Colby, K. rj. , Hilf, F. D., Multidimensional Analysis in Evaluating 
a Simulation of Paranoid Thought, in SUAIM-194. 



(Colby ot ai '71) 

Colby, K. M. / »M a\ , Ar t 1 f i r J ii I ' Pa r ario i a , Artificial IntelligenC€ - 
(Color, ' / .!) 

Coles, L. S\ , Techniques for rnformation Retrieval Using an 
Inferential Question-Answering .system with Natural Language 
Input, SRITN . 1^72. 

(Davidson *G3) 

Davidson, D., Actions, Reasons and Causal Laws, Journal of 
Phi losophy . 

Davies, Isard '12) 

Davies, D. J. M., Isard, S. D., Utterances a.^ Programs, 
presented at the 7th Internat iona 1 Mach ine Intelligence 
workshop, Edinburgh, June 1972. 

(Enea, Colby '73) 

Enea, H., Colby, M., Idiolectic Language-Analysis for 

Understanding Doc t or- Pa t i ent Dialogues, AIJC3. 

(Far radeno * (SG ) 

Farradene, B., Research on Information Retrieval by 

Relational Indexing, Dept. of Information Sciences, City 
University, London. • 

(Goldman • 74 ) 

Goldman, N. M., Computer Generation of Natural Language from 
a Deep Conceptual Base, CAST No. 2. 

(Halliday '70) 

Halliday, M. A. K. , in Foundations of Language . 
(Hayes '71) 

Hayes, P. j.. The Frame Problem and Related Problems In 
Artificial Intelligence, in SUAIM-53. 

(Hayes '74) 

Hayes, P. J., Some Problems and Non-Problems in Representation 
Theory, in AISB. 

(Hays '64) 

Hays, D., Dependency Tlieory: A Formalism and Some Observations, 
Language , Vol. 40. 

(Heidorn '74) 

Heidorn, G. E., Engli:jh a.s a Very High Level Language for Simu- 
lation Programming, in Proc. Symposium on Very High Level Languages 
Santa Monica, Ca. 1*)74. 
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